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CONTRIBUTIONS  TO  THE  THEORY  OF  RANK  ORDER  STATXSTXCS-THE  TOO  SAMPLE  CASE: 

FINE  -TR'JCTITRE  OF  THE  ORDERING  OF  PROBABILITIES  OF  RANK  ORDERS 

I.  Richard  Savage  and  Milton  Sob  el 

1.  Introduction, 

In  constructing  admissible  two  sample  rank  order  testg  one  needs  information 
on.  the  ordering  of  probabilities  of  rank  orders.  Specifically,  if,  under  icms 
restriction  of  the  class  of  alternatives,  tbs  rejection  region  of  a  test  contains 
the  rank  order  %  than  it  should  contain  all  rank  orders  more  probable  than  x. 

This  paper  contains  several  theorem  on  suck  orderings  under  various 
alternative ,  especially  the  location  parameter  case  for  symmetric  distributions. 

2.  Notation  and  Assumptions. 

X  -  (X:  j, . . .  ,X^)  and  7i  =  (Y. , . . .  ,T^  )  are  samples  drawn  from  absolutely 

continuous  populations  with  densities  f ( • )  and  g(*)t  respectively.  F( • )  and 

Of*)  denote  the  Corresponding  distributions. 

(*fi»...jWjWR)  tout  es  the  order  statistics  of  the  combined  sample, 

(X,  Y)  -  (X, ,  Y- , .  # .  ,Y  ),  and  Z  =  (Z Z  )  is  a  random  vector  of 
'1  m  l7  rr  '  '  1  *  nH*n 

zeros  and  ones  whose  i~  component,  Z^,  is  0  if  comes  from  £(•)  and  1  if 
comes  frou  g( • ) . 

Let  t  •-  {*-,•••,*.)  be  a  fixed  vac  ter  ©£  zeros  and  ones;  we  define  the 
i.  uH-n 

co^plemfent  of  s,  zC  =  (x* , . . .  ,z^t_)  and  the  transpose  of  z,  zfc  =  (x^, ), 

. . .  i  nH*n  n  1  ®+n 

to  be,  the  vectors  whose  i—  components  are  1-* .  and  z  ...  respectively. 

i  mtnfl-i 

p(z)  ~  Pr  {Z-z}  denote*  the  probability  of  the  rank  order  z. 

Since  the  following  restrictions  of  f  and  g  are  assumed  in  several  results 
belcw,  we  list  them  now  along  with  a  shorthand  notation. 
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Restriction®; 


ST:  f(x)  =  f («*x)  and.  g(x)  =  f(x-6),  where  9  is  a  non-negative  eonstant. 

Us  f(x)  £  f(x')  if  0  S  x  <  x'  or  x'  <  x  S  0. 

MLR:  g(y)/f(y)  s  g(x)/f(x)  if  x  S  y. 

N:  f  ( • )  and  g(  •  )  are  normal  denaitiee  with  common  variance  1  and 

means  0  and  0,  respectively,  where  0  ^  0, 

Note:  ST  stand®  for  Symmetry  and  Translation  and  U  implies  that  f(*)  i* 

Unimodal.  It  is  assumed,  without  loss  of  generality,  that  the  mode  of  f(*) 
is  the  origin.  MLR  stands  for  Monotone  Likelihood  Ratio  and  N  stands  for 
Normality.  Of  course  N  is  the  strongest  and  implies  the  other  three.  Under 
ST  and/or  N  we  use  the  notations  p(z)  and  P(s|@)  interchangeably. 


3*  Theorems  on  the  Ordering  of  Rank  Order  Probabilities. 
The  general  expression  for  P(jr)  is 

r  p  *** 

(3.1)  P(*)  =  mini  ...  II  h*  (0**4  . 

J  J  i=l  i 


where  h 


^  - 1 


f(tt)  *^0 


s(tt) 


*i=1 


,  and  the  region  of  integration  is 


-»<  t,  l,..g  t  ,  <  cn.  In  particular,  under  ST 

1  mfn  r  ? 


(3.2) 


Theorem  l; 


If  ST  holds,  then  for  all  0 


i)  P(*|@)  k  P(a;t|-0)  and 

ti)  p(z|e)  =  p(zc|-e). 


Proof: 


Recall  the  definition  of  zt  and  zC  and  note  that  f(x)  =  f(-x).  In  the 
integral  (3.I)  (using  (3.-))  make  the  transformation 

11  >  ci  -  (i-i-s . 

or 

ii')  tt  =  0+fcJ  ( i=lf2, . . .  ,nn-n) 

and  i)  or  ii)  follows  at  once. 

Theorem  2: 

If  ST  holds,  then  for  all  6 

p(z|0)  =  P(ztc|6).  (Sea  Savage  (1957)  P*  975.) 

Proof: 

Note  that  ztC  =  (a*)®.  Thus,  by  Theorem  1, 

P(ztc|e)  =  p(*t|-e)  *=  p(*|e). 

Remark 

If  a  result  of  the  form  P(z|0)  5  P(z'|0)  for  0  €  T  is  true  under  ST,  then, 
by  Theorem  2,  the  following  are  also  true  when.  0  €  Tt 

p(zts|e)  s  p(z'|0) 

p(*tc|e)  s  p((z')tc|0) 

p(«|0)  §  p((*’)tc|e)  • 


Theorem  3: 

If  MLR  holds  and  z  and  s'  differ  only  in  their  i—  and  consonants  (i  <  j) 
with  (*t,  ij)  =  (0,  1)  while  («[,  zp  =  (1,  0),  then  P(z)  a  P(z'). 

(See  Savage  (1956)  p.  59^.) 
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Remark 


If  z  and  z5  have  a  common  number  of  zeros  and  ones  and  are  such  that 

1  i2p 

£  (z*-z  )  ^  0,  for  then  there  exist  z  ,z%...,*p,  where 

j=l  3  J 


zK  =  (z^,Zp,  f®r  k=l,...,p  and  z l-z% ,  zP=z,  such  that  for  k=2,o..,p, 

k™  I  k 

z  and  z  differ  in  exactly  two  components,  i^  and  (i^  <  jfc)  with 

(*L  ,  )  =  (0,  1)  and  (z*-\  z*"1)  =  (1,  0). 

Tc  ■'k  k  Jk 


For  example: 

z  =  z'  =  (0,0, 1,0, 1,0,1) 
z3  =  (0,0, 1,0, 1,1,0) 

a2  =  (0,0, 1,1, 0,1,0) 

z'  =  z1  =  (0,1,0, 1,0, 1,0)  . 
Therefore  we  have  the  following  result. 


Corollary: 


If  MLR  hslds  and  z  end 
i 

such  that  £  (z'-z.)  5  0, 

j-1  j  J 


z '  have  the  same  number  of  zeros  and  ones  and  are 
for  i-l,...,mtn,  then  P(z)  ^  P(z').  The  properties 


of  the  orderings  implied  by  Theorem  3  are  discussed  in  detail  in 

In  succeeding  pages  we  enqploy  the  notation  (z,  w),  where  w  = 

and  z  =  (z, ),  to  denote  the  combined  vector  (z-,...,z 

jl  Drn,  l  mfn 


Savage  (I962) 
(*!»..., wm 
»  wi . Vq 


) 

). 


Theorem  k: 

If  ST  and  U  hold,  0  ^  0,  and  z  contains  the  same  number,  r,  of  zeros  and 
ones ,  then 

1)  P(0,0,l,ztC)  fe  P(z, 0,0,1) 

and 

li)  P(l,0,0,ztC)  2  P(z, 1,0,0)  . 
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Proof: 


i)  By  Theorem  1,  a  necessary  and  sufficient  condition  for  the  conclusion 
is  that 

*(■,0,1,1)  £  P(«,0,0,1)  , 

which,  by  (3.1)  and  (3.2)  is  equivalent  to  the  inequality 


(3.3) 


I  =  J  H(x)  F(0-x)[f(x-0)-f(x)]dx  &  0,  for  all  9  a  0, 


where  H(x)  =  (r+2) 


2r 

'•('+1 )!  /  •  •  •  /  II  9(V‘l9>4tl  *<W4W 

"<  cis— 4  W  ‘  *  1-1 


Wa  note  here  for  future  use  that 


(3.M  H'(x)  =  £h(x) 

-  f(x)(r+l)«.(r+2)!  J 


<  tj_  g...S  t2r  *  x 


2r 

/  Tl  f(t1-e«i)dtt 

•  1=1 


=  f(x)  G-(x),  say. 

Let  i(x)  denote  the  integrand  in  (3.3)  and  let 


e/2 

I2  =  J  i(x)dx  . 


In  Ip  make  the  change  of  variable  x  =  0-x*.  This  yields,  after  replacing  x* 
by  x  in  the  transformed  Ip  and  adding  1^  and  Iof 


I 


H(0-x)~ 

F(e-x) 


F(x)  F(6-x)[f(x-0)-f(x)]dx  . 


5- 


It  is  easily  seen  that  STU  implies  [ f  (x-0)-f  (x)  ]  ^  0  for  x  §  0/2. 

Therefore*. s  a  sufficient  condition  for  I  to  be  non-negative  is  that 

Hfel  s  Ill"!),  for  XS  0/2. 

F(x)  F(0-x) 

Since  x.  5  0/2  implies  x  5  0_x  it  suffices  to  show  that  is  non- 

*(*) 

decreasing  for  all  x.  And  for  this  to  be  true  it  is  sufficient  that  ■  »■  ^ 

F(x) 

has  a  non -negative  derivative,  i.e.,  that 
H"(x.)F(x)-H(x)f(x)  &  0 

or,  by  (3.4),  that 

<?(x)F(x)-H(x)  §  0. 

Since  G(x)f(x)-H(x)  =  0  at  x  =  -»  it  suffices  to  shew  that  G(x)F(x)»H(x) 

is  non-decreasing  for  all  x,  or  that 

G®  (x)F(x)-t-f  (x)c(x)~H®  (x)  i  0 

or»  b7  (3«^)»  that 

G*(x)  §  0, 

which  is  clearly  so. 

ii)  The  proof  is  identical  with  that  of  i)  with  the  following  trivial 
modification:  (3-3)  is  replaced  by 

00 

I  =  J'  E^(x)F(-x) [f (x-S)-f (x) ]dx  §  0,  for  all  6  g  0, 


where 


H(x)  =  (r+2) '  (r+1) J 


-  <  tx  *...S  t2r+1  s  x 


r  * 

J  II  f(V‘i*>dti  f(W0>d£2r+l 

i=l 


The  proofs  of  the  next  three  theorems  have  several  features  in  common  which 
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we  note  here.  They  all  state  that  if  N  hold®  then  P(z)  §  P(s').  Equivalent 
conclusions  are  p(z^)  '£  P(z*)  and  P(z)  ^  P(z,tC);  one  or  the  other  is  noted  in 
each  theorem  and  is  in  fact  what  is  proved. 

Tha  first  step  is  to  replace  each  P(*)  with  its  equivalent  under  (3*1) 

(3.2)  and  to  change  the  order  of  integration  so  that  a  particular  pair  of 
variables  is  integrated  last.  For  the  convenience  of  the  reader  this  pair  of 
variables  will  be  indicated  by  adding  primes  (f)  to  the  corresponding  entries 
in  the  z -vectors  th®  first  time  they  appear. 

At  this  point  we  have  an  inequality  of  the  form 

00  00 

S(x,  y)dydx  ^  0 

x 

as  a  necessary  and  sufficient  condition  for  the  inequality  p(z)  £  P(z*).  By 
making  the  transformation  y-x*  &  w,  x  =  x1  we  obtain  the  equivalent  inequality 
(omitting  primes) 

00  00 

S(x,  x+w)dxdw  £  0. 

0  *-•*» 

A  sufficient  condition  for  this  inequality  is  that  the  inner  integral  is 
non-negative  for  w  ^  0,  i.e.,  that 

00 

l(w)  =  J*  S(x,  x+w)dx  ^  0, 

««00 

for  w  ^  0. 

(0-*)/2 

Let  T.^(w)  •-  J  S(x,  x+w)dx  and  I2(w)  =  l(w)-I^(v).  In  I^(w) 

•A 

make,  the  transformation  x'  =  0-x-w;  this  makas  tha  ranges  of  Integration  of 
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I^(w)  and  I0(w)  coincide. 

By  adding  (w)  and  I?(w),  we  obtain 

oo 

I(w)  =  J  T(x,  w)dx  , 

(0-w)/2 

where  T(x,  w)  =  [S(x;  x4w)+S(0-x-w;  @-x)]. 

In  each  case  we  show  that  T(x5  w)  ^  0  for  x  ^  (0- w)/2  and  w  £  0,  which,  of 
course,  implies  l(w)  £  0  for  w  ^  0. 

In  the  proof  of  Theorem  5  we  shall  repeat  in  detail  the  argument  just 
outlined.  By  Theorem  l.i  it  is  necessary  to  consider  only  9  >  0  in  proving 
Theorems  5  and  6. 

Theorem  5  s 

If  N  holds  and  S  |  0,  then  P(l,0,0r,0,l)  >  P'0,l,0r ,1,0)  or,  equivalently, 
P(l,0' ,0r,0'  ,l)  >  P(1,0' ,lr,0' ,1) .  (xr  denotes  a  vector  of  r  x's.) 

Proof: 

By  (3*1)  and  (3.2),  the  inequality 

P(l,0,0r,0,l)-P(l,0,lr,0,l)  S  0 
is  equivalent  to  the  inequality 

/  •  •  •  /f(ti-e) f(t2)f(>„3)!(tM-»)[  n3  *<q) 

"<ti^tr4<"  1=3 

r+2 

-  n  f(t1-e)]dt1...dtr+]f  s  o. 

i=3 

Integration  of  the  above  with  respect  to  all  the  variables  but  t^  and  ty 
(call  them  x  and  y,  respectively),  yields  the  equivalent  inequality 

00  00 

f  J  F(x-e)F(e-y)([P(y)-P(x)]r-[F(y-0)-F(x-e)]r)f(x)f(y)dydx  g  0. 

-»  x 
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If  we  transform  th®  integral  by  letting  x  =  x*  and  y  =  xf4w  and  drop  the 


primes  we  get  the  inequality 


00  00 

(3.5)  J  J  F(x-e)F(e-x-w){[F(xw)-F(x)]r-[F(x+w-0)-F(x-e)]r)f(x+w)f(x)dxdw  g  0 


0 


Let  l(w)  denote  the  inner  integral.  If  l(w)  ^  0  for  all  w  ^  0,  then  it  is 

00 

clearly  so  that  J  l(w)dw  ^  0,  therefore  a  sufficient  condition  for  (3.5) 

0 

(hence  for  the  conclusion  of  the  theorem)  is  that  l(w)  §  0  for  w  ^  0. 

Let  S(w,  x)  be  the  integrand  in  (3*5).  Then 


l(w)  =  J  s(w,  x)dx  +  J 

(0-w)/2 


(e-w)/2 


S(w,  x)dx 


In  the  second  Integral  l*t  x'  =  0-x-w;  the  result,  after  omitfing  primes  and 
combining  the  two  integrals,  is 


F(x)F(6"X~w)f (x+w)f (x-0)([F(xtw-0)-F(x-0) ]r 


-  [F(x+w)-F(x)]r) 


E(-x-w)f(x4w-9)  _  F(x-0)f(x)'|dj|. 
f(x+w)F(0-x-w)  f(x-0)F(x)_ 


Clearly,  a  sufficient  condition  for  l(w)  to  be  non-negative  for  w  ^  0  is 
that  the  integrand  above,  call  it  T(x,  w),  is  non-negative  for  w  ^  0  and 

x  ^  (e^w)/2. 

The  expression  in  braces  in  T(x,  w)  is  non-negative  if  and  only  if 
[f(x+v-0)-F(x-0)]-[F(x+w)-F(x)]  ^  0  , 

for  w  ^  0  and  x  ^  (@-w)/2.  This  is  clearly  so  since  the  left  member  of  the 
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Inequality  is  the  difference  of  the  probability  contents  of  two  intervals  one 
of  which  is  more  central  than  the  other* 

By  the  corollary  to  Lemma  1  of  Appendix  I,  the  term  in  square  brackets  is 
non-negative  for  x  £  (@-w)/2  and  w  ^  0*  Therefore  T(x,  w)  ^  0. 

Theorem  6: 

If  N  holds  and  6  ^  0,  then  P(0r ,0, l,l,0,0r )  >  P(0r , 1,0,0, l,0r)  or,  equivalently, 
P(lr»l' >0,0,1' ,ir)  >  P(0r,l',0,0,l',0r). 


Proof; 

Proceeding  as  was  outlined  above,  one  obtains,  as  a  sufficient  condition 
for  the  inequality  P(lr,l* ,0,0,1* ,lr)  ^  P(0r,l* ,0,0,1* ,0r) ,  the  inequality 

T(x,  w)  =  f  (x-0)f  (x4w-0)f  (x)f  (x+w)  [G2(x;  w) 

v  r  *  } 

-  G2(x-0;  w)]([F(x-0)F(e-x-w)]r-[F(x)F(-x-w)]r}  g  0, 
for  0  g  0,  w  g  0,  and  x  g  (0-w)/2,  where 


(3.6) 


G(x;  w)  = 


F(x4v)-F(x) 


>J2ft  f( 


x+w 


)f(- ) 


\f2  & 


By  the  corollary  to  Lemma  2  of  Appendix  I,  with  r  =  w/2,  y  =  x-r,  the  term 
in  square  brackets  is  non-negative  for  9  ^  0,  w  £  0,  and  x  £  (0-jw)/2* 

Therefore  T(x;  w)  is  non-negative  provided  the  term  in  braces  is  non-negative. 
This  term  is  non-negative  if  and  only  if 


[F(x-0)f(@-x-w)-F(x)F(-x-w) ]  1  0,  for  x  ^  (0-w)/2  . 


This  inequality  is  proved  in  the  corollary  to  Lemma  3  of  Section  5. 


Theorem  Ji 

If  N  holds  and  0^0,  then  P(0, 1,1,0,*)  ^  P(l, 0,0,1,*)  for  any  s  or, 
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equivalently,  P(z,lf ,0,0, 1* )  ^  P(z,0* ,1,1,0* ) . 

Proof; 

Proceeding  as  was  outlined  above,  one  obtains  as  a  sufficient  condition 
for  the  inequality  P(z,0,l,l,0)  ^  P(z,l,0,0,l) ,  the  inequality 

T(x,  w)  =  [h(x)-H(0-w-x)]{G2(x;  w)-G2(x-0;  w) }f (x)f (x+w)f (x-0)f (x+w-0)  *  0, 

for  w  ^  0  and  x  ^  (0-*f)/2,  where  G(x;  w)  is  defined  by  (3*6)  and 

h(x)  .  j  .  .  .  J  n°  . 

-»  <  t-  ^  t  <x 
1  nH-n 

m  and  n  being  the  number  of  zeros  and  ones  in  z. 

It  is  shown  by  the  Corollary  to  Lemma  2  of  Appendix  I  that  the  term  in 
braces  in  T(x;  w)  is  non-negative  for  w  ^  0  and  x  ^  (0-w)/2. 

Clearly,  H(x)  is  everywhere  non-decreasing.  Since  x  1  (0-w)/2  implies 
x  ^  0-w-x,  we  have 

H(x)  *  H( 0-w-x)  , 

for  w  £  0,  x  ^  (0-w)/2.  Thus,  the  term  in  square  brackets  is  non-negative,  and, 
therefore,  so  is  T(x,  w). 

k •  Exanyles  and  Conjectures. 

The  following  diagrams  illustrate  the  theorems  of  Section  3«  The  symbol 

s  s’  means  P(s)  ^  P(s*)  for  0^0  (under  ST,  STU,  or  N)  under  conditions 

a  be.  C  stands  for  Conjecture.  The  table  acco^anylng  some  of  the  diagrams  is 
extracted  from  an  unpublished  table  of  probabilities  of  rank  orders  under  N 
confuted  by  Jerome  Klots  (1962).  Mote:  MLR  lnplles  a  sl^le  ordering  of  the 
P(s)  for  n=l.  Hence  the  first  Interesting  case  is  m=n=2.  All  diagrams  derived 
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are  distributive  lattices  but  the  conjectured  diagram  for  m=4  and  n=2  is  not 
distributive;  in  particular  it  does  not  satisfy  the  Jordan-Dedekind  chain 
condition,  i.e.,  not  all  chains  from  an  arbitrary  fixed  z  to  (say)  the  least 
probable  rank  order  are  of  the  same  length. 


The  notation,  crossover 


z 

f  ,  denotes  the  fact  that  there  exist  two 

2 


values  of  0,  9^  >  9^  >  0,  such  that  P(z|@1)  >  P(z,|@1)  but  p(z|@2)  <P(s,|@2). 


m=n=2 


m=3>  n=2 


0011 
^|mlr 
0101 
I  MLR 


0110  IS  1001 


Jmlr 
1010 
Jmlr 
1100 


00011 
[mlr 
00101 
Jmlr 
01001 


'Wi 

I" 

mo 

i" 

noo 

J 

)011( 

Is1 

000 

I" 

>101, 

IlKX 

10010 


.MLR 

lotoo 

MLR 

y 

11000 


00110 

|st  and  U 
10001 

l" 

01010 

01100 
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0=4,  n=2 


000011 

Jmlr 

000101 

JmLR 

001001 

In 

'l' 

000110 

Ordering  from  ] 

MLR  ^  v 

510001 

000011 

001010 

1 

000101 

J?*4: 

001100 

_  —  "c  Jmlr 

001001 

190001 

000110 

010001 

OK>OlO 

\T 

001010 

“MLR 

100001 

010100 

xopoio 

001100 

MLR  ^  ^  C 

£ 

010010 

dnooo 

010100 

j? 

100010 

100100 

1 

011000 

Jmui 

100100 

101000 

1 

101000 

Imlr 

110000 

110000 
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m=n^3 


001110 


000111 

MLR 

N/ 

001011 

MLR 

\/ 


V/ 


ST 

100101  =  010110 
I  MLR 


I" 

ST  ( 

i 


ST 

101001  Si  011010 


1? 
100110 


110001 


JMLR 
110100 

111000 


Ordering  from  Klots  Table 


000111 

001011 

001101  =  010011 
010101 

100011  =  001110 
011001 

100101  =  010110 
101001  =  011010 
100110 

110001  =  011100 
101010 

110010  =  101100 
1101000 
111000 


* 


*  crossover 
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3 


m=kf  n- 


0000111 

MLR 

0001011 


Ordering  from  Klotz  Table 


* 


0000111 
0001011 
0010011 
0001101 
0100011 
0010101 
0001110 
rOO 11001 

j  0100101 
'-1000011 
0010110 
0101001 
0011010 
1000101 
0100110 
0110001 
0011100 
1001001 


m=4,  n=3 


*  crossover 


0101010 

1000110 

1010001 

0110010 

0101100 

7*1001010 

*  -l  1100001 
'-0110100 
1010010 
1001100 
0111000 
1100010 
1010100 
1011000 
1100100 
1101000 
1110000 


}* 

}* 


* 

* 


For  fixed  m  and  n  we  define  N(z)  and  N'(s)  to  be  the  number  of 


rank  orders 


less  probable  and  more  probable  than  z,  respectively.  The  ideal  situation  for 
constructing  tests  of  hypothesis  is  to  have  H(z)+Hf(z)  =  (®^n)-l,  i.e.,  the 
rank  orders  form  a  chain.  The  following  table  gives  H(x)f  N* (s)  and  N(*)+N'(z) 
for  n=3  for  the  ordering  implied  by  Theorem  3  alone  and  for  the  ordering 


lulled  by  Theorem  1  through  7.  Note  that  the  second  ordering  is  an  iiq>rovemant 
over  the  first  in  the  sense  that  N(s)+N,(s)  for  the  second  ordering  is  not 


smaller  than  that  for  the  first.  In  particular  there  is  considerable  ln?rovement 
in  *  =  (1,0,0, 0,0, 1,1),  (0,0, 1,0, 1,1,0),  (0,1, 1,0, 0,0,1)  and  (0,0, 1,1, 1,0,0) . 
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MLR  1 

I  MLR  or  STU  or  N 

z 

»(*) 

N'(«) 

N(z)+N'(z) 

N(z) 

■'(«) 

H(z)+H'(z) 

0000111 

3^ 

0 

3>k 

3^ 

0 

3^ 

0001011 

33 

1 

3^ 

33 

1 

3^ 

0010011 

30 

2 

32 

30 

2 

32 

0001101 

29 

2 

31 

29 

2 

31 

0100011 

Qk 

3 

27 

25 

3 

28 

0010101 

27 

k 

31 

28 

k 

32 

0001110 

19 

3 

22 

22 

3 

25 

0011001 

21 

5 

26 

Qk 

5 

29 

0100101 

22 

6 

28 

22 

6 

28 

1000011 

lk 

k 

18 

19 

5 

Qk 

0010110 

18 

6 

2k 

21 

1 

7 

28 

0101001 

20 

8 

28 

20 

8 

28 

0011010 

15 

8 

23 

17 

8 

25 

1000101 

13 

8 

21 

16 

8 

Qk 

0100110 

15 

9 

Qk 

I 

15 

11 

26 

0110001 

12 

9 

21 

16 

9 

25 

0011100 

9 

9 

18 

11 

11 

22 

1001001 

11 

11 

22 

12 

12 

Qk 

0101010 

13 

13 

26 

13 

13 

26 

To  complete  the  table  note  that  N(zfc)  =  Nf(z). 


Appendix  I. 

Proper t lee  of  Some  Function*  Related  to  the  Normal  Penalty  Function 

In  the  following  f  ( • )  and  f(*)  denote  the  standard > normal  density  and 
distribution  function,  respectively* 


If  9  is  a  positive  constant,  then  G(x)  =  is  non- increasing 

F(x)f(x-e) 

for  all  x. 
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Proof: 


A  sufficient  condition  for  the  monotonicity  of  G(x)  is  that  its  first 
derivative  is  non-positive  for  all  x,  or,  equivalently,  that 

G1 (x)  =  0F(x)F(x-0)+F(x-e)f(x)-F(x)f(x-6)  S  0, 

for  all  x. 

Since  =  0,  a  sufficient  condition  for  G^(x)  ^  0  is  that  G^(x)  is 

everywhere  non-decreasing,  which  is  so  provided  the  first  derivative  of  G^(x) 
is  non-negative. 

Now, 


Let  Gg(x)  =  .  Clearly,  the  term  in  square  brackets  is  non-negative 

(hence  ^  G^x)  a  o)  if  G2(x)  is  non- deer easing  for  all  x,  that  is,  if 

f"*(x)[xf  (x)+F(x)(x2+l)]  £  0  . 


This  is  clearly  so  for  x  1  0.  To  see  that  it  follows  for  x  <  0,  let 
G^(x)  =  [xf(x)+F(x)(x2+l)].  Since  G^(-«0  =  0  we  need,  as  was  noted  above, 
show  only  that  G^(x)  is  non-decreasing  for  all  x,  or  that 

G^(x)  =  2[xF(x)+f (x) ]  ^  0,  which  follows  at  once  from  the  Feller-Lap  lace 
inequality: 

F(x)  §  for  x  <  0  . 


Corollary: 

If  w  and  6  are  non-negative  constants,  then  G(0-x-w)  ^  G(x)  for  x  1  (0-w)/2. 
Proof: 

The  conclusion  follows  at  once  from  the  fact  that  0-x-*  i  x  whenever 

x  §  (e-w)/2. 

-18- 


Lemma  2; 


If  r  is  a  positive  constant,  then  H(y,  r)  =  —  is 

f(X±£)f(Z=E) 

vj2  <J2 

non-decreasing  for  y  ^  0. 

Proof; 

A  sufficient  condition  for  H(y,  r)  to  be  non-decreasing  for  y  £  0  is  that 
its  first  derivative  is  non-negative,  or,  equivalently,  that 

H^y,  r)  ■s"-f(y+r)-f(y-r)+y[F(y+r)-F(y-r)]  £  0  . 

Since  H^y,  0)  =  0  it  i»  eufficient  te  .how  that  H^y,  r)  U  increaaing 
in  r  for  r  ^  0  and  fixed  y  §  0,  or  that 

r)  =  r [f (y-r)-f (y+r) ]  g  0  , 

for  y  £  0  and  r  £  0,  which  is  clearly  so. 

Corollary: 

Let  9  be  a  positive  constant,  then  [H^y;  r)-H2(y-0;  r)]  £  0  for  all 
y  £  9/ 2  and  r  1  0. 

Proof: 

It  is  evident  that  H(y;  r)  is  synetrlc  about  y=0  (for  fixed  r  2  0), 
therefore  H(y-0;  r)  is  symmetric  about  9 .  In  the  interval  [9/2,  9],  H(y-0;  r) 
is  decreasing  while  H(y;  r)  is  increasing.  Since  the  two  are  equal  at  y  =  9/2 , 
clearly,  H(y-0;  r)  is  less  than  or  equal  to  H(y;  r)  in  this  interval.  Since 
R(y-0;  r)  is  Increasing  to  the  right  of  this  point  and,  y  £  y-0,  one  has 
H(y;  r)  ^  H(y-0;  r).  Since  H(*)  is  non-negative,  the  result  follows  at  once. 

Leans  3; 

Let  r  be  a  positive  constant,  then  F(y-r)F(-y-r)  is  non- increasing  in  y 
for  y  ^  0. 
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Proof: 


It  is  enough  to  show  that  the  first  derivative  is  non-positive,  or, 
equivalently,  that 

f_(y+4  g  ifcgl 

F(y+r)  F(r-y) 
for  r  ^  0,  y  §  0* 

Since  equality  holds  for  y=0  it  is  enough  to  show  that  non¬ 

increasing  for  all  t,  or  that  -tF(t)*»f(t)  ^  0,  for  all  t.  If  t  g  0 
this  is  clear,  if  t  <  0  apply  the  Feller-Lap  lace  inequality 

F(t)  S  4^  • 


Corollary: 

If  6  and  w  are  non -negative  constants,  then 
F(x-0)F(0-x-w)-F(x)F(-x-w)  £  0 

for  x  ^  (0-w)/2. 


Proof: 

Let  H(y;  r)  =  -F(y-r )F (-y-r) ,  using  this  notation  ve  are  to  show  that 
H(y;  r)-H(y-6;  r)  S  0 

for  y  fe  8/2  and  r  £  0  whara  H(y;  r)  is  non-dacraaalng  for  y  S  0  and  synnaeric 
about  y=0.  This  is  proved  as  in  the  corollary  to  Lemma  2. 


Appendix  II, 

Selected  Numerical  Results 

The  following  tables  give  for  several  s's,  values  of  P(s)  for  different 
values  of  6  under  condition  N.  These  tables  were  extracted  from  an  uijpubllshed 
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table  of  Klotz.  Attention  is  directed  towards  z  =  (1,0, 0,0, 0,1, 0,1)  and 


z*  =  (0,0, 1,0, 1,0 ,1,0) .  This  was  the  first  example  of  a  pair  of  rank  orders 
with  common  m  and  n  values  for  which  we  have  found  the  function  P(z|0)-P(z5  |  9) 
to  change  sign  on  the  positive  9  axis.  The  second  example  of  such  a  ’'cross¬ 
over1'  on  the  positive  9  axis  that  we  found  was  with  the  vectors  z  =  (0, 1,0, 1,0, l) 
and  z 1  =  (0,0,1,1,1,0)  [or  its  equivalent  by  ST,  z”  =  (1,0,0, 0,1,1) ] ,  where  m=n=3. 
An  exhaustive  search  has  not  been  made  of  the  Klotz  tables. 

crossover  defined  on  page  12. 


P(z)  for  selected  values  of  9  under  condition  N  when  m=3  and  n=2  (from  Klotz) 


\  9 

*\ 

.25 

.50 

1.0 

1.5 

2.0 

3.0 

4.0 

5.0 

6.0 

00011 

.114-772 

.20814 

.36243 

.54014 

.70717 

.92051 

.98746 

.99883 

•99993 

00101 

.12978 

.15869 

.19948 

.20069 

.16348 

.06050 

.01115 

.00112 

•046 

01001 

.11445 

.12292 

.11764 

.08837 

.05260 

.OO968 

.00080 

•0^3 

•°g64 

00110 

.10975 

.11333 

.10088 

.07097 

.03976 

.00655 

.00049 

.0^2 

.0634 

10001 

.09706 

.08874 

.06209 

.03439 

.01517 

.00154 

•O4T 

•0^153 

.0?1 

01010 

.09669 

.08741 

.05838 

.02982 

.01166 

.00081 

.042 

•°617 

0 

01100 

.08568 

.06899 

•03710 

.01552 

.00505 

.00025 

.0^63 

•V 

0 

10010 

.08193 

.06290 

.03041 

.01125 

.00317 

.00011 

•0^125 

0 

0 

10100 

I 

.07253 

.04946 

.01905 

.00567 

.00130 

•v 

.0623 

0 

0 

11000 

.06443 

.03942 

.01255 

.00318 

.00064 

•V 

•V 

0 

0 

Subscripts  on  the  first  zero  after  the  decimal  Indicate  the  number  of  zeros 


to  be  entered;  for  example,  .0^6  stands  for  .00006. 
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This  appears  to  ba  another  crossover  but  it  is  not  clear  tliat  the  eighth  decimal 
should  be  trusted  in  this  calculation* 


M 

4J 

o 

rM 

u 


u 

M4 


I 

5Z3 

g 


1 

M 

1 

<D 

O 


> 

*J 

g 

H 


g 

4-1 


M 

Pm 


5 


H 


s 


4J 

« 

45 

I 


1 


S 

s 

s 

3 


4J 

*4 

1 

g 

2 


M 

V 

l 

CO 


M 

8 

g 
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p(z)  for  selected  values  of  0  illustrating  a  "crossover"  and 
"symmetrical  displacements"  (from  Klotz) 


\  0 

z  \ 

.25 

.50 

1.0 

1.5 

2.0 

3.0 

4.0 

5.0 

6.0 

Example  o: 

:  a  cross: 

.ng  over. 

10000101 

.01911 

.01851 

.01285461 

.00601 

.00190 

I 

.o644 

0 

0 

00101010 

Effect  of 

.01933 

moving  it 

.01878 

i  from  bot 

.01285266 

th  ends. 

LT\ 

O 

O 

.00168 

• °6 19 

0 

0 

10000001 

.03442 

.03082 

.01984 

.00958 

.00351 

.00022 

.0^516 

.°t5 

0 

01000010 

.03^19 

.03000 

.01778 

.00744 

.00220 

.0^6815 

.°s53 

0 

0 

00100100 

.03418 

.02997 

| 

.01771 

.00737 

.00216 

.0^6541 

0 

0 

00011000 

.03426 

.03025 

.01841 

.00804 

.00253 

•<\9 

,o696 

0 

0 

Subscripts  on  the  first  zero  after  the  decimal  indicate  the  number  of 


zeros  to  be  entered;  for  example  .0^6  stands  for  .00006. 


Appendix  III. 

Approximations  to  P(i|0)  under  N 
Theorem  8: 

If  N  holds,  then,  for  all  0, 


p(«) 


mfnx-1 
n  ' 


#-n©2/2  E  2  ,u) 

1=1 


f 


where  v. ,  are  the  order  statistics  of  a  sample  of  else  mfn  drawn  from 
l  mfn 

a  standard  normal  population. 


Proof: 


We  note  that  in  this  case 


-s4e2/2  st  0 

f(tt-*t0)  =  •  «  1  f(tt)  . 
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Thus 


P(z)  =  mini 


~  ui-rii. 

j  ■  ■  ■  j  n  '('i-i9)"! 

-»  <  t-  t  <  oo  i=1 

1  mfn 


mfn 

n 


) 


1  -xi62/2 


(mfn)  I  J 


<  t,  g 


mfn 


mfn 


•-  <  00 
mfn 


exp (6  L  z^}  [j  f(t1)dt1. 
i=l  i=l 


Remarks 

The  first  terms  in  the  Maclaurin  expansion  of  P(z|0)  give  approximations 
to  P(z}  0)  for  small  0.  For  example 

.  mfn 

P(*|  ®)  =  +  9  S  *1EW  )  . 

i=l 

Tables  of  the  approximation  got  by  including  the  next  (O2)  term  in  the  Maclaurin 
expansion  of  P(z|0)  are  in  preparation. 

An  interesting  asymptotic  result  is  given  by  Hodges  and  Lehmann  (1962). 

This  should  give  approximations  to  P(s|0)  for  large  0;  this  point  has  not 
been  investigated,  however. 


Appendix  IV. 

Some  Nonlinear  Relationships  Between  Rank  Order  Probabilities 

In  Savage  (196o)p.  520,  linear  relationships  like  the  following  have 
been  obtained: 

p(0,l,l)  =  [P(0, 1,1,0)  +  P(0, 1,0,1)  +  2P(0,0,l,l)]/2  . 

A  pair  of  non-linear  relationships  is  obtained  below.  Note  that  no  restriction 
is  made  of  the  densities  f(*)  and  g(*). 
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Theorem  9‘ 


A:  P(0, 1,1,0)  =  2P(0,1,1)  -  2P2(0,l) 

B:  P(0, 1,0,1)  =  2P2(0,1)  -  2P(0, 0,1,1)  . 


Proof: 


We  note  first  that 
00 

P2(0,1)  =  [ J  F(x)g(x)dx]2 
-00 


F(x)g(x)F(y)g(y)dxdy 


=  2 


J! 


-O0  X 


F(x)F(y)g(x)g(y)dydx  . 


Then  to  prove  A,  one  has 


00  00 

P(0, 1,1,0)  =  kjj  F(x)[l-F(y)]g(x)g(y)dydx 

-08  X 


-«  X 

=  2P(0,1,1)  -  2P2(0,1)  . 
And  to  prove  B,  one  has 


J  F(x)g(x)g(y)dydx  -  2P2(0,l) 


00  00 

P(0, 1,0,1)  =  kj  J  F(x)[F(y)-F(x)]g(x)g(y)dydx 

-»  x 


00  00 

-  2P2(0,1)  -  kj  J  F2(x)g(x)g(y)dydx  =  2P2(0,1)  -  2P(0, 0,1,1). 

X 
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Corollary  1: 


P(l, 0,0,1)  =  2P(l,0,0)  -  2P2( 1,0) 
P(l, 0,1,0)  =  2P2(1,0)  -  2P(1, 1,0,0) 


A': 


B1: 


Proof: 

Simply  interchange  F  and  G  (f  and  g)  in  the  proofs  of  A  and  B. 
Corollary  2: 

P(0, 0,1,1)  +  P(l, 1,0,0)  =  2[P(0,l,l)  +  P(1,0,0) ]  -  1  . 


Proof: 

The  set  of  all  possible  rank  orders  for  m=n=2  is  an  exhaustive  set  of 
mutually  exclusive  events.  Therefore 

P(0,0,l,l)+P(l,l,0,0)+P(0,l,0,l)+P(l,0,l,0)+P(l,0,0,l)+P(0,l,l,0)  =  1  . 

Substituting  the  right  members  of  A,  B,  A'  and  B'  for  P(0,1,1,0),  P(0, 1,0,1), 
P(l, 0,0,1)  and  P(l,0,l,0),  we  obtain 

P(0,0,1,1)  +  P(l, 1,0,0)  =  2[P(0,1,1)  +  P(l»0,0) ]  -  1  . 


Note  that  probabilities  for  all  of  the  rank  orders  with  »=n*2  can  be 
evaluated  in  terms  of  the  probabilities  for  smaller  san^le  sises  and  P(0, 0,1,1) 
or  P(l,l,0,0)e  More  generally,  for  n^2  and  arbitrary  fixed  m=M  let 


a  = 


ri 


> 


where  r^+r^+r^  =  M. 


MI2! 

=  r  »r  »r  » 

12  3 


Then 

J  *  *  *  J  Fri(x)[F(y)-F(x)]r2[l-F(y)]r3g(x)g(y)dxdy 

-«  <  x  ^  y  <  oo 


Mi2! 


_  I  _  t  _  » 

l#r2,r3*  l^i^r 


-  -  r^+r  -(i.+O  p 

s  (;2x'3x-i) 2  3  i 2  f 

i“a  1  2  J 


lsi  sr 

2"  3 


•  •  Fl 

-•  <  x  ^  y  <  • 

?r3+1r12 


r,+r  -i. 

2  1(x)* 
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(y)g(*)g(y)<fawiy 


For  a+b  <  M,  the  integral 


J  *  •  *  J Fa(x)Fb(y)g(x)g(y)dxdy 

-00  <  x  ^  y  <  00 

can  be  expressed  as  a  linear  combination  of  probabilities  of  rank  orders  for 
m  <  M  and  n=l  or  2.  Therefore  if  all  rank  order  probabilities  for  m  <  M  and 
n=l  and  2  have  been  confuted,  the  only  new  integrals  required  are  of  the  form 


-  /  •  •  •  /r‘< 


x)FM_i(y)g(x)g(y)dxdy 


1=0 . M 


-oo  <  x  ^  y  < 


Since 


A1+AM-1  =  J  *  *  ‘  J  [Fl(x)FM"1(y)+FM'1(x)Fl(y)]g(x)g(y)dxdy 

-»  <  x  ^  y  <  » 


oo  oo 
■ // 


(y)g(x)g(y)<btdy 


=  t 


w  0* 

/  Ft(x)g(x)dx]  [ J  FM-i(y)g(y)dy] 


on*  n**d*  to  coapute  only  one  of  th*  peir  (A^,  A^  . 

For  n  >  2  we  oust  consider  n-fold  integrals  of  th*  form 

. 1n)  =  J  ...  J  I]  F  ',(xj)g(Xj)«*xj  . 

<  X-  X  <  «•  J=1 

1  n 

n 

as  above  only  those  integrals  for  which  £  1  =  M  need  be  evaluated.  Then  if 

J=1  J 

any  of  the  ij=0  the  dimensionality  of  the  integral  is  easily  decreased. 
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Generally, 


n 


where  the  summation  is  over  all  permutations  of  (l,2,..e,n). 
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